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Introduction 

This  volume  contains  two  sections.  Part  I presents  the  rationale 
and  methods  used  In  the  statistical  computer  analysis  of  the  language  use 
data  supplied  by  jobholders  In  a post-interview  survey.  It  discusses 
calculation  by  hand  and  by  computer,  describes  the  circumstances  In  which 
each  Is  most  appropriate,  and  gives  "how  to  do  It"  directions  for  each 
approach.  The  section  Includes  sample  worksheets  and  computer  punch  cards, 
and  also  a copy  of  the  post-interview  survey  questionnaire  used  In  the 
data  collection.  It  should  be  noted  that  the  post-interview  questionnaire 
presented  here  Is  an  example  of  a follow-up  survey  rather  than  a general 
model.  A follow-up  survey  Is  needed  when  examination  of  the  Initial 
Interview,  observation  or  Initial  survey  data  shows  that  unanswered  questions 
remain  or  that  certain  sections  need  clarification.  Under  those  circumstances 
a follow-up  survey  Is  designed  to  answer  the  specific  questions  or  to 
clarify  the  remaining  "muddy"  points.  It  Is  clear  then,  that  a follow-up 
survey  will  not  be  needed  In  all  cases;  nor  Is  It  possible  to  design  a 
standard  follow-up  survey  form. 

It  Is  Important  to  note  that  the  statistical  methods  described  In 
Part  I are  applicable  to  the  analysis  of  data  obtained  by  means  of  all  the 
data  collection  methods  which  are  part  of  the  overall  analysis  system: 
Interview,  observation,  and  both  Initial  and  follow-up  surveys. 

Part  II  of  the  volume  presents  samples  of  the  Instruments  used 
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In  the  collection  of  data  on  language  requirements  of  jobholders.  Three 
different  kinds  of  Instruments  are  Included:  the  Structured  Interview, 
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featuring  both  a Sequential  and  a Categorical  routine,  the  Structured 
Observation,  and  the  Initial  Survey.  Together  with  the  follow-up  survey 
(see  Part  I)  they  cover  all  the  possible  data  collection  circumstances 
Involved  In  assessing  the  language  needs  of  military  jobholders. 


STATISTICAL  ANALYSIS 


The  survey  questionnaire  of  foreign  language  requirements  was  analyzed  by 
means  of  simple  descriptive  statistics  which  can  be  calculated  easily  by  hand 
or  computer.  The  following  report  will  explain  how  to  conduct  the  analysis  by 
hand,  how  to  communicate  your  needs  to  a computer  programmer,  and  how  to  pre- 
pare the  data  for  keypunching.  A sample  of  the  computer  program  used  In  this 
report  Is  also  Included.  These  procedures  will  follow  Immediately  after  a 
description  of  the  type  of  analysis  that  Is  recommended,  the  rationale  for  It, 
and  other  uses  that  might  be  made  of  the  data. 

Descriptive  Statistics 

The  primary  requirement  In  this  questionnaire  Is  to  determine  the  average 
rating  that  Is  assigned  to  each  coomunlcatlve  task  and  topic.  These  averages 
are  computed  for  each  of  the  four  criteria  (mission  criticality,  foreign 
language  necessity,  performance  frequency,  and  language  learning  difficulty). 

An  overall  average  Is  then  computed  for  each  task  and  topic.  Once  these 
averages  are  obtained,  the  tasks  and  topics  can  be  rank-ordered.  This  rank 
ordering  demonstrates  which  tasks  and  topics  are  perceived  to  be  most  Important 
by  the  persons  responding  to  the  questionnaire. 

Rationale 

These  data  are  collected  and  the  statistics  computed  to  assist  In  decision 
making,  but  It  must  be  kept  in  mind  that  they  do  not  take  the  place  of  decision 
making.  There  are  several  reasons  for  this.  The  level  of  analysis  used  In 
this  survey  Is  sufficient  to  Illustrate  the  frequency  and  Importance  of  the 
tasks  based  on  the  experience  and  perceptions  of  the  respondents.  By  the  same 
token.  It  Is  Important  to  accurately  gauge  the  representativeness  of  the  res- 
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pondents  in  terms  of  their  experience  and  their  qualifications  for  judging  the 
range  of  topics  included  in  their  specialty. 

Other  factors  that  must  be  kept  in  mind  when  evaluating  these  data  Include 
the  issue  of  past  experience  versus  predictions  of  the  future.  A questionnaire 
survey  tends  to  reflect  the  past  experience  of  the  respondents.  If  changes  in 
doctrine,  or  other  characteristics  of  the  job  are  anticipated,  then  the  survey 
data  have  to  be  qualified  appropriately. 

In  summary,  the  point  being  made  here  Is  that  the  decision-maker  has  to 
understand  what  functions  these  data  do  and  do  not  serve.  All  too  often  there 
Is  a tendency  to  bestow  a degree  of  certainty  and  confidence  on  quantitative 
data  that  Is  not  warranted  when  other  factors  are  considered.  That  is  why  It 
Is  important  to  remember  that  these  data  assist  in  decision-making;  they  do  not 
replace  it.  On  the  positive  side  decisions  can,  of  course,  be  greatly  improved 
by  knowledge  of  the  actual  frequencies  of  events,  and  that  Is  the  rationale  for 
the  use  of  quantitative  methods  in  task  and  job  analysis. 
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Elaboration 

A 

There  are  alternatives  to  the  descriptive  level  of  statistics  used  in  this 
analysis  but,  before  considering  them,  it  would  be  well  to  recall  a stanza  from 

' j 

the  famous  cowboy  song,  "The  Old  Chisolm  Trail".  It  goes  something  like  this: 

! 

Got  a ten-doll ar  horse 
And  a forty-doll ar  saddle. 

And  I'm  goin'  to  punch 
Them  Texas  cattle. 

Statisticians  sometimes  present  us  with  the  same  situation.  They  would  saddle 

A j 

us  with  methods  that  are  more  sophisticated  than  the  level  of  decision-making 
that  is  actually  taking  place.  In  order  to  analyze  the  data  from  the  Language 
Requirements  Survey,  simple  descriptive  statistics  are  sufficient.  By  tabu- 
lating frequencies  and  computing  averages,  the  task  analyst  can  determine  which 
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tasks  and  topics  are  considered  to  be  most  Important  by  the  respondents  and  how 
they  are  rank-ordered.  These  summaries  will  usually  be  adequate  when  combined 
with  the  current  doctrine  and  priorities  in  an  occupational  specialty  to  serve 
as  a basis  for  determining  the  tasks  to  be  Included  In  the  Communicative  Task 
Statements. 

However,  It  Is  possible  to  conduct  more  sophisticated  analyses  with  the 
data  that  are  collected  with  this  Instrument.  For  example.  If  doctrine  Indi- 
cates that  "Performance  Frequency"  Is  considerably  more  Important  than 
'Language  Learning  Difficulty"  In  determining  which  tasks  to  Include  In 
training,  then  that  criterion  could  be  given  a weighting  to  double  or  triple 
Its  Influence  on  the  overall  average  score. 

If  the  task  analyst  wants  to  explore  questions  about  the  relative  Impor- 
tance of  various  criteria,  or  about  characteristic  patterns  as  Indicated  by 
the  responses  obtained  in  the  survey,  then  even  more  complex  analyses  could  be 
conducted.  The  analyst  could  determine  whether  there  are  statlstica’ly  signi- 
ficant differences  among  the  four  criteria  for  given  tasks  or  topics.  Multi- 
variate factor  or  cluster  analyses  could  be  conducted  to  see  whether  there  are 
characteristic  differences  In  certain  groups  of  respondents  with  respect  to 
certain  tasks  and  topics. 

However,  many  of  these  procedures  begin  to  fall  Into  the  category  of  the 
"forty-dollar  saddle".  Analyses  conducted  with  the  simpler  level  of  statistics 
will  be  sufficient  for  the  level  of  decision-making  that  Is  taking  place.  The 
more  sophisticated  analyses  would  be  utilized  more  In  research  than  In  task 
analysis  projects.  The  Information  might  be  Interesting,  but  would  not  lead 
to  the  development  of  differentiated  programs  of  Instruction  due  to  the  cost 
Inefficiencies  Involved. 
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Hand  Versus  Computer  Analysis 

This  is  one  situation  where  the  decision  to  use  a computer  is  based  on 
labor  rather  than  complexity.  The  procedure  for  analyzing  the  data  is  very 
simple.  The  computer  would  be  used  when  the  size  of  the  survey  is  large,  or 
when  the  analyst  expects  to  use  more  complex  levels  of  analysis.  The  procedure 
for  computing  frequencies  and  averages  is  presented  below  and  is  followed  by  a 
discussion  of  approaches  to  using  the  computer. 

Hand  Calculation 

Following  is  the  format  for  a worksheet  (Exhibit  1)  that  can  be  used  to 
tally  the  results  for  each  task  and  topic  with  respect  to  each  criterion. 

These  worksheets  also  illustrate  how  to  compute  the  average  and  record  the 
range  of  scores  in  each  case.  These  worksheets  may  be  duplicated  and  passed 
out  to  a number  of  personnel  who  can  set  up  an  assembly  line.  The  first  per- 
son can  tally  the  results  of  the  first  page  on  a series  of  worksheets  and 
then  pass  the  questionnaire  to  a second  person.  This  reduces  the  likelihood 
of  error  since  each  person  sets  up  a limited  field  of  concentration  and 
establishes  a pattern  of  recording  the  responses.  It  also  reduces  boredom  to 
have  a number  of  persons  working  at  the  same  time.  The  blank  worksheet 
(Exhibit  1)  is  followed  by  a hypothetical  example  (Exhibit  2)  based  on  a 
survey  of  twenty-three  infantrymen  with  respect  to  the  Russian  language. 

A convenient  way  to  record  the  results  is  to  use  a copy  of  the  survey 
form  (as  we  have  done).  The  frequency  (Column  C totals),  average,  and  range 
can  be  inserted  in  place  of  the  response.  The  overall  average  for  each  topic 
and  task  can  be  easily  obtained  by  adding  the  means  for  each  criterion  and 
dividing  by  four.  The  overall  average,  also  known  as  the  mean  of  the  means, 
is  then  recorded  in  the  right-hand  margin.  The  rank-ordering  of  tasks  and 
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EXHIBIT  1 

COMPUTATION  WORKSHEET 


TASK  OR  TOPIC: 


CRITERION: 


A)  Response 

B)  Tally  C)  Total 

0)  Multiplier  E)  Value 

1.  Very  Critical 

a 

X 1 

2.  Critical 

s 

X 2 

3.  Important 

« 

X 3 

4.  Not  So  Critical 

a 

X 4 

Col  min  C Total 

Column  E Total 

To  obtain  average: 

♦ 

s 

Colunn  E Total  Column  C Total 

Average 

to 


To  obtain  range: 


Lowest  Response 
Chosen 


Highest  Response 
Chosen 
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EXHIBIT  2 


COMPUTATION  WORKSHEET 


TASK  OR  TOPIC 


J^n  i'&~r-oci&bon 


CRITERION:  MtSS/en  CrjtiCaJ<1 


A)  Response 

1.  Very  Critical 

2.  Critical 

3.  Important 

4.  Not  So  Critical 


B)  Tally  C)  Total  D)  Multiplier  E)  Value 


X 1 
X 2 


X 3 


X 4 


Column  C Total  o*3 


Column  E Total 


V2- 


To  obtain  average: 


V-2- 


/S') 


Column  E Total  Column  C Total  Average 


To  obtain  range: 


> to 

Lowest  Response 
Chosen 


Highest  Response 
Chosen 


iwr — 
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topics  can  be  determined  from  the  means  recorded  on  the  survey  form. 

It  will  be  noticed  that  a statistic  called  the  standard  deviation  is 
included  in  the  data  surrmary  sheets  of  this  report  but  is  not  included  in  the 
hand  calculations.  This  statistic  is  Interesting  and  is  easily  obtained  from 
a computer  analysis  of  the  data,  but  it  is  not  essential  and  it  is  time- 
consuming  to  compute  by  hand.  The  standard  deviation  indicates  the  amount  of 
divergence  in  the  responses.  It  is  similar  to  the  range.  The  range  indicates 
the  spread  in  the  data;  that  is,  the  minimum  and  maximum  scores.  The  standard 
deviation  indicates  how  similar  the  responses  were  or  were  not.  The  smaller 
the  standard  deviation,  the  greater  the  tendency  for  all  of  the  responses  to 
equal  the  mean;  the  larger  the  standard  deviation,  the  greater  the  tendency 
for  the  scores  to  be  equally  spread  between  the  minimum  and  maximum.  In  the 
present  situation  the  spread  of  scores  is  limited  to  four,  so  the  standard 
deviation  is  not  as  important  as  in  other  contexts. 

Computer  Calculation 

If  the  number  of  respondents  in  the  survey  prohibits  hand-processing  of 
the  data,  or  if  complex  statistical  analyses  will  be  conducted,  then  it  would 
be  appropriate  to  have  the  data  prepared  for  entry  into  a computer  for  analysis. 
Generally  speaking,  the  best  approach  to  using  the  computer  when  you  are  not 
already  practiced  in  its  use  is  to  present  your  needs  to  a consultant  at  the 
computer  center.  The  consultant  will  want  to  know  what  your  input  (the  survey 
forms)  looks  like  and  what  It  is  that  you  want  in  the  way  of  output.  He  will 

then  be  able  to  advise  you  as  to  how  to  have  the  data  keypunched  for  entry 

Into  the  computer.  He  will  also  know  what  analytical  programs  are  available 

at  the  computer  center  that  will  meet  your  needs,  or  he  will  be  able  to  write 

an  original  program. 
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To  assist  you  In  this  process  and  to  familiarize  you  with  the  type  of 
information  that  will  be  helpful  to  the  consultant,  the  remainder  of  this 
section  includes  an  example  with  an  explanation  of  the  basic  computer  analysis 
used  in  this  project. 

Formatting  the  Data 

The  first  step  in  preparing  the  data  for  keypunching  and  entry  into  the 
computer  is  to  organize  it  in  a manner  that  is  suitable  for  the  computer  and 
statistical  program  that  you  will  use.  One  Of  the  most  frequently  used 
statistical  packages  that  is  used  with  survey  data  such  as  these  is  the 
Statistical  Package  for  the  Social  Sciences  (SPSS).  It  is  very  flexible  in 
that  after  the  data  are  in  the  computer  they  can  be  reorganized  as  necessary 
to  conduct  different  types  of  analyses.  Some  other  programs  require  the  data 
to  be  keypunched  in  a rigidly  prescribed  format  in  order  for  the  analysis  to 
run  properly.  The  SPSS  package  was  used  in  this  project  and  the  following 
examples  illustrate  its  use. 

The  data  for  this  project  were  formatted  in  a very  straightforward, 
unambiguous  manner.  A number  of  variables  were  defined  on  the  cover  sheet  of 
the  questionnaire  in  order  to  include  the  demographic  information  in  the  com- 
puter file.  These  are  described  in  Exhibit  3.  The  responses  were  keypunched 
by  beginning  with  the  first  task  (Instructing)  and  recording  the  responses  to 
each  of  the  four  criteria  as  separate  variables.  The  same  procedure  was 
followed  until  we  came  to  the  end  of  the  eleven  tasks  listed  on  Pages  2-5  of 
the  questionnaire  (Exhibit  6).  We  skipped  Page  6 in  the  computer  analysis  because 
of  the  variation  in  the  topics  that  were  volunteered.  On  Page  7 we  used  the  same 
method  to  record  the  responses  to  the  tasks  printed  in  the  questionnaire,  and 
we  again  skipped  the  fill-in  tasks. 
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The  data  on  Page  8 had  to  be  prepared  for  keypunching.  The  respondents 
were  asked  to  select  and  rank-order  the  five  most  important  tasks  and  the  five 
most  important  topics.  The  soldiers'  responses  had  to  be  transferred  to  the 
lists  of  tasks  and  topics.  All  tasks  and  topics  that  were  omitted  were  given 
a value  of  zero.  That  way,  each  task  and  topic  is  Included  as  a variable  In 
the  analysis,  and  each  of  these  variables  receives  a value  of  zero  or  its  rank 
order  (highest  = 5,  lowest  = 1)  for  each  respondent.  Exhibit  4 Illustrates 
the  list  of  tasks  with  one  respondent's  rank  order  decisions,  and  the  same 
list  of  tasks  after  It  was  coded  for  keypunching. 

On  the  final  page,  each  culture  area  was  Included  as  a variable,  and  the 
ratings  were  recorded  as  In  the  earlier  sections  of  the  questionnaire.  In  all 
cases  only  the  printed  culture  areas  were  recorded.  Fill-in  responses  were 
not  Included  in  the  computer  analysis  because  of  their  lack  of  comparability. 

The  complete  list  of  variables  Is  Included  In  Exhibit  3.  This  exhibit 
Includes  the  code  words  used  for  each  variable,  the  number  of  columns  required 
to  record  each  variable,  and  the  number  of  cards  needed  to  record  all  the 
variables.  It  can  be  noted  that  three  cards  (records)  were  needed  to  record 
all  of  the  variables  for  each  soldier  who  responded. 

The  Computer  Program 

There  are  three  basic  categories  of  Input  cards  that  are  required  to  con- 
duct a statistical  analysis  In  a computer.  The  first  Is  the  local  control 
cards  that  contain  your  password  and  activate  the  computer  for  your  use.  The 
second  group  Is  the  program  control  cards.  They  either  activate  an  analytical 
program  that  Is  already  on  the  computer,  or  they  contain  the  program  that  Is 
to  be  used.  The  third  group  consists  of  the  actual  data  cards. 


used  In  this  project.  They  are  the  cards  that  activate  the  SPSS  package  and 
tell  it  what  you  want  to  do.  They  also  Include  Information  about  the  number 
of  persons  (cases)  in  your  data  deck,  the  list  of  variables,  and  how  the  vari- 
ables are  organized.  The  program  control  cards  for  SPSS  would  be  almost 
identical  to  these  regardless  of  which  computer  you  use,  but  you  should  rely 
on  your  computer  consultant  for  any  peculiarities  of  your  system  or  special 
characteristics  of  your  data. 

Summary 

There  is  no  doubt  that  the  computer  offers  many  advantages  in  data  analy- 
sis. It  provides  you  with  a complete  record  of  each  person's  responses  and 
allows  you  to  subdivide  the  sample  in  any  way  you  wish  In  order  to  compare  one 
group  of  respondents  with  another.  It  also  allows  you  to  quickly  and 
inexpensively  conduct  a variety  of  complex  statistical  programs.  But  there  is 
also  the  fact  that  some  time  and  expense  is  involved  In  preparing  the  data  for 
analysis  and  activating  the  system.  The  final  decision  to  use  the  computer  or 
to  conduct  the  analysis  by  hand  will  depend  on  the  size  of  the  survey  and  the 
types  of  analyses  to  be  conducted. 
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EXHIBIT  3 

LIST  OF  VARIABLES 


According  to  your  input  format  variables  are  to  be  read  as  follows: 


VARIABLE  FORMAT  RECORD 


COLUMNS  DESCRIPTION 


casecoi 

SPFRC 

INST 

LANG.. 

MOS 

RANK 

MO  Sc  XP 

SFEXP 

INSTMC 

INSTFL__ 

INSTPF 

INSTLL  • 

DE8RMC 

OEBRFl 

OEBRPF 

OEBRLL  . 

BRIEFMC 

BRIEFFL- 

BH  IEFPF 

BRIEFU.  - 

CQNVRMC 

CONVRFL — 

CCNVRPF 

CONVRLL 

ADV1 SMC 

AOVl SFL  - 

AOV1SPF 

AOVISLL 

INVEWMC 

INVEWFL 

INVEwPF 

I NVEWLL 

INRUGMC 

INROGFL 

INROGPF 

1NROGLL 

1NPRTMC 

INPRTFL 

INPRTPF 

INPRTLL 

MON ( T MC 

monitfl  ■- 

MONI  TPF 
MON!  TLL 
HE  VMC 

REvFl 

REVPF 

REVLL 

SCANMC 

SCANFL  • - 

SCANPF 

SCANLL  . 

1TIMC 


F 

F 

F 

F . 
F 
F 
F 

.F. 

F 

..F. 

F 

F - 
F 

-F- 

F 

.F 

F 

F - 
F 

F.f 

F 

F- 

F 

H 

F 

F . 
F 
F 
F 

F., 

F 

F 

F 

-F. 

F 

F 

F 

F.- 

F 

F. 

F 

F-. 

F 

F 

F 

F... 

F 

F . 
F 

-F-. 

F 

F 

F 


2 8—  — 28 


2 9- 
30- 

3 1- 
3 2- 
3 3- 

34- 

35- 

36- 

3 7- 

38- 

39- 

40- 

4 l- 
42- 
4 3- 
44—. 
4 5- 
4 6- 
4 7- 
48-  . 

4 9- 
50- 

5 1- 
52- 
5 3- 

54- 

55- 

56- 
5 7- 
58- 

4- 


29 

30 

31 
• 32 

33 

34 

35 
-36 

37 

38 

39 
-.40 

4! 

42 

43 
-44 

45 

-46 

47 

.48 

49 

50 

51 

52 

53 

54 

55 

56 

57 
56 

4 


An  Identification  number 
Special  Forces  7 or  5 
Instructor  or  not 
Fgjjeign  Language 

Rank 

Experience  in  MOS 
Experience  in  Special  Forces 
Instructing:  Mission  Criticality  (MC) 

: Foreign  Lang  Necessity  (FL) 


Debriefing 
Briefing 

Conversing 

Advising 

Interviewing 

Interrogating 

Interpreting 

Monitoring: 

Reviewing 

Scanning 

In8tr.ToplcI 


Performance  Frequency  (PF) 
Language  Learning  DlTf^ijl 


MC 

FL 

PF 

LL 

MC 

ft 

LL 


PF 

LL 

MC 

FL 

PF 

LL 

MC 

FL 

PF 

LL 

MC 


LL 

MC 

FL 

PF 

LL 

MC 

FL 

PF 

LL 

K 

PF 

LL 

MC 

FL 

PF 

LL 

MC 


EXHIBIT  3 


LIST  OF  VARIABLES  (Continued) 


Instructional  Topic  I:  FL 

: PF 
: LL 

etc. 


IT1FL 
ITlPF 
I T ILL. 
IT2MC 

I T2FI 

I T 2PF 

I T2l_J_  .. 

IT3M<; 

IT3Fl_  . 

IT3PF 

IT3LL- 

IT4MC 

IT*F|_ 

IT4PF 

IT4LI.  - 

IT5MC 

IT5FL.- 

IT5PF 

IT5LL.— 

IT6MC 

IT6FL  . 

IT6PF 

I T 6LL.  - 

IT7MC 

IT7FL 

IT7PF 

IT7LL-. 

IT8MC 

IT8FL .... 

ITflPF 

IT8H._ 

IT9MC 

IT9FI 

IT9PF 

I T9l_l_... 

ITIOHC 

ITIOFL 

ITIOPF 

JTIOLL. 

IT l l MC 

ITllFC 

IT11PF 

IT  1 ILL 

IT  12  MC 

IT12FL 

IT12PF 

IT12LL 

IT13MC 

IT13FL 

IT13PF 

1T13LL 

IT14MC 

IT14FL. 

IT14PF 

IT14LL 

IT15MC 

1T15FL 

ITISPF 

ITiSLL 

IT16MC 

IT16FL 

IT16PF 

IT16LL 

IT17MC 


(Note  that  this  sequence  is  repeated 
18  times.  It  allowed  for  as  many  as 
18  instructional  tasks  to  be  included 
in  the  questionnaire  for  each  occupa- 
tional specialty.  The  questionnaire 
for  a given  occupational  specialty 
would  have  to  be  consulted  to  see  the 
specific  instructional  tasks.) 
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EXHIBIT  3 

LIST  OF  VARIABLES  (Continued) 


IT  1 7Fl_ 

ITI7PF 

F 

F 

• 0 2 

. 0 * 2 

69—  - 

70-* 

69 

70 

IT  171.1.  -- 

F 

. . 0- 2 

7 |m... 

71 

1 T 1 BMC 

F 

• 0 2 

7 2- 

72 

1TIBFI 

F - 

0 2 

73m_ 

-73 

IT IBPF 

F 

• 0 2 

74- 

74 

ITiail  

F - 

• 0 2 

7 5m  - _ 

78 

INSTRO ' 

F 

• 0 3 

4- 

4 

OEBHFRO  

F 

,.o r n 

- 

-.5. 

BRIEFRO 

F 

• 0 3 

6- 

6 

CONVNQ  . . . 

F 

• 0 .. -3 

. 7m_. 

- 7 

AQVRQ 

F 

. 0 3 

a- 

8 

1NVE WRO 

F .. 

•..0  3 



—9 

I NROGRO 

F 

• 0 3 

1 0- 

10 

INPRETRO 

F 

..  0 3 

. . 1 im  .. 

1 1 

MUNI  TWO 

F 

• 0 3 

1 2- 

12 

RE  WHO  . 

F 

• 0 - 3 

1 3w 

.13. 

SCANRO 

F 

• 0 3 

14- 

14 

ITA 

F 

. 0 3 

IS« 

18 

1 TAB 

F 

• 0 3 

th- 

16 

1TC  . 

F 

• 0. .3 

.1  7w  .... 

17 

1TD 

F 

• 0 3 

18- 

18 

ITE .. 

F 

. 0-. ..  . . 3 

...  _ | 9m-l- 

.19 

ITF 

F 

• 0 3 

. 20- 

20 

ITG 

F_ 

• _ 0 — _.  3 

2 l-_. 

21 

1TH 

F 

• 0 3 

22- 

22 

IT  I.,. 

F . 

,..0 ..... 3 

23m 

23 

ITJ 

F 

. 0 3 

24- 

24 

ITK ' . 

F _ 

• .0  — 3 

25-r. 

28 

ITU 

F 

• 0 3 

26- 

26 

ITU 

F- 

0 3 

...  2 7« 

27 

ITN 

F 

♦ 0 3 

28- 

28 

I TO  __  _ . 

F 

a 0 ...  .....  3 

_.29-t  . 

29 

I TP  . 

F 

• 0 . .3 

30- 

30 

*TO 

F . 

• A - - v 

1 1- 3 1 

ITR 

F 

• 0 3 

3 2- 

32 

ITS  

F 

• 0 juL.w_3 

33**. 

33 

ITT  . 

F 

. 0 . . 3 

34- 

34 

m 7f  |)<t  ‘ - 

F- 

; ; a o— 

40 

HISTORY 

F 

:*0  3 

4 1- 

41 

LOKECON  ..  . 

F 

• 0 i.v3 

_ 4 2-  .... 

42 

INOIGMP 

F 

• 0 3 

4 3- 

43 

Rttl  C ,V- 

H .. 

, A i 

Ma 

44 

ART 

F 

• 0 3 

48- 

48 

MUSIC  . 

F . 

..  0 L ~v.,3 

...  46*r.. 

46 

FAMU.YST 

F 

• 0 3 

*?T 

47 

ATWOMEN 
ATCHILO 
ATELOErt~. 
AT FOR UN 
BYSUB  ARC. 
AOPRACT 


,F~ 

F 

F . 
F 

R * 
F 


QRUGALC— . F_ 


Instruction  Rank  Order  (R.O.) 
Debriefing  R.O. 

Briefing  R.O. 

Conversing  R.O. 

Advising  R.O. 

Interviewing  R.O. 

Interrogating  R.O. 

Interpreting  R.O. 

Monitoring  R.O. 

Reviewing  R.O. 

Scanning  R.O. 

Instructional  Task  "A"  Rank  Order 
Instructional  Task  "B"  Rank  Order 


Business  Custom 

History 

Local  Economy 

Indigenous  Medical  Practices 

Religion 

Art 

Music 

Family  Structure 
Attitude  Toward  Women 
Attitude  Toward  Children 
Attitude  Toward  the  Elderly 
Attitude  Toward  Foreigners 
Buying-Selling- Bargaining 
Agricultural  Practices 
Use  of  Drugs,  Alcohol 


I 


r 
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EXHIBIT  4 


CODING  OF  RANK-ORDER  DATA 


A.  Below  is  a representation  of  an  infantryman's  rank-ordering  of 
the  most  important  communicative  tasks  in  Russian: 


A.  instructing 

B.  debriefing 

C.  briefing 

D.  conversing 

E.  advising 

F.  interviewing 

G.  Interrogating 

H.  Interpreting 

I.  monitoring 

J.  reviewing 

K.  scanning 

L.  

M. 


1st  A 
2nd  fl 
3rd 

4th  n 
5th  fc 


B.  To  be  prepared  for  keypunching,  the  tasks  are  nunbered  and  values 
assigned  as  follows: 


1.5A. 

2. jj_  B. 

3. _3  C. 

4.  > D. 

5. j_  E. 

6.  o F. 

7.  q G. 

8. _o  H. 
* ol. 

o J. 
o K. 


9 

10 

11 


instructing 

debriefing 

briefing 

conversing 

advising 

Interviewing 

Interrogating 

Interpreting 

monitoring 

reviewing 

scanning 


r 
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Data  Collection  Instruments 

Part  II  of  this  volume  presents  the  Instruments  to  be  used  to 
collect  data  from  jobholders  about  the  foreign  language  requirements 
of  their  job  positions. 

The  first  Instrument  Is  the  Structured  Interview;  It  comes  In 
two  different  versions,  the  Sequential  Routine  and  the  Categorical  Routine. 

The  Interview  consists  of  a structured  series  of  questions  about  the 
potential  comnunlcatl ve  activities  that  could  be  involved  in  job  performance. 
The  interviewer  Is  expected  to  adhere  reasonably  closely  to  the  organization 
and  sequence  of  the  Interview  as  presented,  but  s/he  should  also  remain 
open  to  unsolicited  details  and  anecdotes  If  the  jobholder  volunteers 
them. 

The  Observation  Instrument  offers  guidelines  to  the  analyst  who 
wishes  to  observe  actual  or  simulated  job  performance.  It  points  out 
aspects  of  language  performance  to  which  attention  should  be  directed 
during  the  observation  period.  The  Observation  Instrument  can  be  success 
fully  employed  with  both  live  and  "canned"  samples  of  job  performance. 

That  is,  the  observer  or  jobholder  may  tape  record  language  Interactions 
for  subsequent  analysis  using  the  Observation  Instrument. 

It  should  be  noted  that  successful  data  collection  will  be 
expedited  by  the  combined  use  of  the  Interview  and  Observation  methods 
during  a site  visit. 

The  Initial  Survey  Instrument  Is  a "self-instructional"  version 
of  the  Structured  Interview  Instrument.  It  Is  designed  to  be  used  In 
settings  where  a site  visit  Is  not  possible,  and  can  be  administered  by 
mall  If  necessary.  Use  of  the  Initial  Survey  Instrument  alone  Is  the 
data  collection  approach  of  last  resort.  It  cannot  replace  face  to 
face  Interaction  between  the  jobholder  and  the  analyst. 
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STRUCTURED  INTERVIEW:  FI  REQUIREMENTS  FOR  JOB  TASKS 
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N0S/J0B: 


TASK 


Nlaa Ion 
Crlt icalltv 


Foreign 
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Noctulty 


Performance 

Frequency 


l«very  critical 
2«crlc leal 
3»l«por tint 
4»not  so 
Important 


1- very  neceasary 

2- neceaaa  ry 

3- helpf ul 
4>unnecaaairy 


1- dally 

2- week  ly 

3- monthly 

4- leas  chan 

monthly 
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Learning 
D1 f f lculty 


1- very  difficult 

2- dlfflculc 

3- about  average 

4- easy 
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I ANWIAQ  niNHlONS 


Vanguaqr  functions  ar#  the  purpose  people  u*e  language  to  accomplish,  • or  <>«(h  of  the  ten 
quaqe  functions  listed  below,  ulr  the  fre^uenc^  with  which  it  1%  u'p.1  in  the  Job  t*Ni  and 
Its  «.  r 1J  < \ « 1 1 tj[  to  vuupvsIviI  perf  orwmcV  i'f  lob  task.  tor  !um  t lotu  judged  htqhl*  hi 
tlcil,  pTease  esplatn  w^j  It  Is  critical  to  successful  pert  oriMn*  e , 


9*i hit"}*  greetings 

request  Information 
or  0bj9Ct% 

9 * p r # s s opinion 

give  information 

grant  or  deny 
r9(|U9S  t s 

a Nik  questions 

arque /persuade 

stat«  1 ncomprthens ton 

express  agrtamtnt/ 
dl sagreement 

ask  for  suggestion 

prats#  someone, 
something 

thank 

Inquire  about  moral 
Judgment 

apologl I# 


If  krUUnhty  rating 
In  1 , 2 , or  .1 , answer 
thlN  section: 

WMf  CR  t T 1C  At  ? 


give  directions 

give  safety  warnings 

express  Intention  to 
do  something 

express  emotional 
state 

Introduce  one  person 
to  another 

correct  (factual 
Information) 


Not  at 

Very  all  fre- 

freguent  quent 

1 2 3 4 S 

1 2 3 4 S 

1 2 3 4 $ 

1 2 3 4 S 

1 2 3 4 S 

1 2 3 4 S 


Not  at 

Highly  all  crl- 

crltlcal  tlcal 

1 2 3 4 5 

1 2 3 4 $ 

1 2 3 4 $ 

1 2 3 4 $ 

1 2 3 4 $ 

1 2 3 4 $ 


WHY  CRITICAL? 
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MOS/JOB : 


1 
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3 

4 

5 

6 

7 

8 
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10 

11 

12 
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k. 

CD 


TOPIC  PRIORITY  DETERMINATION 


Mission 

Criticality 

l*very  cr it  leal 

2-er it  leal 
3* impo  r t ant 
4*not  so 
impo  r t ant 
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TOPIC  DESCRIPTOR 
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3- helpful 
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Dif  f iculty 

1 - very  difficult 

2- dlff icult 
3*about  average 
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Audience/Respondent  Identification  CONDITIONS  STATEMENT 


STRUCTURED  INTERVIEW:  FL  REQUIREMENTS  FOR  JOE  TASKS 


11-4* 


m 


n c.3  rawcs  tpaglathg 


^ C'73k isaaoL 


11-54 


co 

o 


& 


••N  | 

• *9  —•  <fl  W I u I -TJ 

(i  « ao  <g  w x « w 9 

<*  C « O 3 0 3 0 0 

«•<*-«»•  C HO  0 B o.  c 
w a c t-  b.  o e 99 

c 4)  9 <h  <o  • c b.  a 

vuJc.j-au^co  cr 
Jd>0£*-tr«ccuco*'HOi 
b. 

O XX  *9  10  W O O S t'  « U 

3*  UK*  C*.  U : « oO-n  >, 

u a 4»  b.  co  * oj  c o oo  o w x 

o«oexo.-4r4  « 9 o o »-  o 

U £ >,  o U »uuTUK«C 

W 9 9 b.  * 41  C C P « W 4 

3 9 • C X 4. 

omx«>C'o«o.b  c j cm  a 

>so«w  •»4»>(-<a3>v’HC'HO 
tj  m *j  *j  o 9 o •-<  ti  -w  uh 
w *j  a TJ  OMO*H«  4-  j* 

O u W09<**‘09T]994-tO<AM 

M ii  ) a o auo  « « 

4*  jC  -o  V*  U k<  II  u X W X 

9 wT3eO9u0OXU4*j£<c  3 

X tt  IIMM  a3U.u»OiM# 

-<  J(  £ «»•  b.  >s  0 « *>£  « 

h a w m v u ■avxw  U"4 

-ri  o a a • 9 »-  • 9 

d u ) u u ®o«*’>9099X99 

r-«  c 9 c >v  w *w  w x *j  b. 

a 41  <4  41  OCX  OX  41  «J  OX 

o aaa  c • « w x 9 - 4-,  h 

) II  K H M Q 9 9 « £ II  >.« 

X <*  >»  W • -*»-•  a 9 W T5  -4  X 

H u g ><b  w a O 4)01  •« 

■o  u • 4 u e b*  — o a oi  mx 

93419  >t<Hh3|«06C« 

0 0W«S9UXX00'^ki-*40-H«( 
SeX9b.9XOwww»XO.>Ow*J 


C 9 9 

O w 

4»  4k  • 


■V 

41  4- 

W -r*  >v 

(0  41 

9 -OX 

u v y *u  c 

4 > w-*  *J  < 

*-i  O.  X 

c B *o  a 

v«  9 a x • 

X 9 r-> 

41  41  • 

W 4>  C X 

<0  U C 4»  (0 

O O *9  9 

9 b.  C H 

3 - O 

*9  41 

b • V b b 

9 9 > 9 O 

T)  b H £ M 

*-  a o « 4» 

O W > -H  X 

O C 41 

•n  a -•  4> 

o w c e 

V»  4)  **«  O 
41  9 U -O 

D.  9 9 

>\*9  C 9 


U w 

9 >,  a 9 ^ 

bm  a u n 

44  O *4  C W O 

O Q.  *J  O O *j 

BOO  9 

X O C 9 W 

(A  U 9X9 

9 T5  b.  4J  0. 

*-<  *J  C O 9 

m d m u b 

9 3 9 3 0. 

x a oo  x x 

*■<  c o 

9 t*  (A  • 3 

9 X w tftb 

> 9 C C 

<fl  •-  -4  9 -M  9 • 

X 00  U 0.4-.  » W 

C X -K  9 9 9 

>»  -H  O -H  X W 
CO  4-»  9 -<-t  b u <J 

3 9 X *-*  X 9 

<h  b b a B 

V*  V»  9 «-*  9 

9 X b«  Cb  fl  O *u 

o o a *9  o 

ri  4 v 9 u C 


w 41  9 0 X 4- 

H X *9  4-. 

b«  -<  9 WO 

x o w x a '9 

ax 

o in  9 a o 

■H  *H  £ * 

9 u a w *j 

x c x o o b* 

H -H  w OX  9 


C O 9 

00  9 -H  9 X 9 

c a m 9 

•w  fi  9 9 X O 

U |l  M £ 0*0 

U 00  b u b 

a 9 x x « 

■O  ao  3 X 

C 9 9 C 


b*  O -O  3 9 
0X990 


e c » w 9 


(X  f~i  9 00  9 

9 9 x c a 

■o  *J  -rt  etc 

C c *9  c 
v*  4-  9 -h  9 
O O > «H 
9 O 

X X W c 

9 9 0.  00 
>%  9 C 44 
« U c *>  * 
a o o u 

9 9 O 
#£  b WM 
X u 9 C 


i a b ii 
> C « 9 
» 0 W 


9 9 9 9 1 

•b  U 9 O U 

i a 9 e a i 

BW«w«wu- 
9 W o a 9 

M • tr  9 W 

9 6 SK  9 9 

O W 9 99 


-OCB  •* 

N * < b b C 

C *9  a 9 9 -H 

■H  b 4i  U W b*  C 

9 9 X 9 9 P -H 

a u w *j  T3  w a 


PRIORITY  TASK  DETERMINATION 


MOS/JOS: 

Mission 

Crlc lcalltv 

Foreign 

Language 

Necessity 

Performance 

F requency 

Learning 

Dtf  f lculty 

l"very  critical 
2-cr 1 tic  al 

3»impor t ant 

4*not  so 
iapo  r tant 

l«very  necessary 

2- necessary 

3- help  f ul 

4- unnecessary 

1- daily 

2- weekly 

3- monthly 

4- less  than 
monthly 

1- very  difficult 

2- d 1 f f lcult 

3- about  average 

4- easy 

TASK 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 


ABBREVIATED 

DESCRIPTOR 


I T r'  U i r~:'’rt» 


LANGUAGE  FUNCTIONS 

n 

language  functions  are  the  purpose  people  use  language  to  accomplish.  For  each  of  the  lan- 
guage functions  listed  below,  rate  the  frequency  with  which  It  Is  used  In  the  job  task  and 
its  criticality  to  successful  performance  of  the  job  task.  For  functions  judged  highly  crl 
1 1 cal , pi  ease  exp 1 al n why  It  Is  critical  to  successful  performance. 


lANCiUAilt  FUNCTION 

exchange  greetings 

request  Information 
or  objects 

express  opinion 

give  Information 

grant  or  deny 
requests 

ask  questions 

argue/persuade 

state  Incomprehension 

express  agreement/ 
di sagreement 

ask  for  suggestion 

praise  someone, 
someth  1 ng 

thank 

Inquire  about  moral 
J udgment 

apol  og 1 ze 


If  criticality  rating 
Is  1 , 2 , or  3 , answer 
this  section: 

WHY  CRITICAL? 


w > 


give  directions 

give  safety  warnings 

express  Intention  to 
do  something 

express  emotional 
state 

Introduce  one  person 
to  another 

correct  (factual 
Information) 


Not  at 

Very  all  fre- 

frequent  quent 

12  3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 


Not  at 

Highly  all  crl 

critical  tlcal 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 


' 


WHV  CRITICAL? 


aiwiicffTifc  t*i:  pacit  p?  cateqdpical  rdlti  e 


Aud i ence/Respondent  Ident I f I cati on 
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TOPIC  PRIORITY  DETERMINATION 


NOS/JOB: 

Mission 

Criticality 

Foreign 

Language 

Necessity 

Ferforaancc 

F requency 

Learning 

Difficulty 

1-very  critical 

1-very  necessary 

l-dallv 

1-very  difficult 

2-cr it  1c  al 

2-necessary 

2"veeklv 

2-dlf f icult 

abbreviated 

TOPIC  DESCRIPTOR 

3-  import  ant 

4- not  so 
important 

3- help  f ul 

4- unnecessary 

3-«ont h lv 
A-less  than 
■onthl y 

3-about 

A-easy 

1 

1 2 3 A 

1 2 3 A 

1 2 3 A 

1 2 
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i 2 3 A 

l 2 3 A 

1 2 3 A 
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Observation  Instrument:  Notes 


•The  Structured  Interview  instrument  specifies  both  a set  of 
procedures  and  an  order  in  which  they  should  be  carried  out.  In  contrast, 
the  Structured  Observation  instrument  specifies  aspects  of  job  performance 
to  which  attention  should  be  directed,  but  does  not  specify  a sequence  of 
steps. 

•In  certain  circumstances  it  is  advisable  to  have  the  jobholder 
tape  record  samples  of  his/her  own  job  performance  without  the  presence  of 
the  task  analyst.  Examples  of  these  circumstances  might  be  situations 
where:  (a)  the  job  holder  engages  in  one  activity  for  long  periods,  and 
the  analyst's  time  would  be  wasted  if  he/she  observed  all  of  it,  or  (b) 
ones  in  which  the  jobholder  engages  in  an  activity  only  occasionally  at 
a time  which  does  not  coincide  with  the  analyst's  scheduled  observation 
period. 


STRUCTURED  OBSERVATION:  FL  REQUIREMENTS  FOR  JOB  TASKS 


“ 

«t  t 

1 

• O 

M « 

M *J  ■*« 

• TJ  a»  « 

• -i  Tj 

*0  C -i 

•O  M • 

4j  .j  m 

-*«>*»  D* 

0 C -h 

0 \ 3 M 

■c  « « w 

■«  » 0 4 

■K  TJ  C « 

tj.cc 

4 h C u u 

•O  1 w 0 

O 0 • -i  * 

0 • -i  -i 

■*■>  ft  a.  * e 

•“>  W » 4* 

o 

• 

* ••i 

0 

1 •»  c c ** 

C 1 

^ Sl‘1’1  0 » 

* TJ  • o 

• *1  • *J 

• »■*  3 •->  1 

•ts  *j  k a,  4j  « 

^ HO  • I 

•*i  a u -i  1 »■« 

-<  a * • a* 

0 4 O « «l  Q. 

0 *1  « ^ 

■C  *j  -cow 

■c  *>  > c * 

*»  »l  <%  «l 

m u m u Q 

•*  G M ^ B *J 

•o  O «i  0 

0 0 *»  0 O C 

0 O N C C -i 

■^0  4 *«  O h 

« H -M  *i 

11-69 


Initial  Survey  Instrument:  Notes 


•The  Initial  Survey  instrument  is  a version  of  the  Structured  Interview 
instrument  which  has  been  modified  for  independent  use  by  the  job  holder  when 
a site  visit  by  a task  analyst  is  not  possible. 

•Since  the  Initial  Survey  instrument  is  composed  of  two  sections.  Part  A 
and  Part  B,  it  is  important  that  the  job  holder  is  careful  to: 

1)  complete  both  parts 

2)  accurately  follow  the  directions  for  moving  between  the  parts 
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